INTEGRATED COMMUNICATION SYSTEM 
AND METHOD 

Background of the Invention 

[0001] This application claims the benefit of U.S. Provisional 
Application Serial Number 60/208,364, filed May 31 , 2000 and incorporated 
herein by reference. 

[0002] The present invention relates generally to a system and 
method for conducting surveys, and more particularly to an at least partially 
automated and efficient method and system for collecting, processing, and 
displaying customer satisfaction survey information that enables a product or 
service provider to evaluate the quality of goods and/or services received 
based on ratings and reports obtained by performing surveys of customers, 
employees, and/or staff. 

[0003] Conventional approaches for surveying consumers of products 
and services, such as health care services, generally use standard survey 
forms or questionnaires, whereby an agent calls or visits a survey participant 
and performs the survey. Alternatively, the participant may be mailed a 
survey form for completion. 

[0004] However, these methods of performing surveys are inefficient 
and often inaccurate. Individual agents are typically used to perform the 
survey, and to tally and process the results into an assessment as to how well 
an organization is performing. Although computers are likely to be used to 
analyze the survey data, human agents are still typically used to enter the 
data into a computer or to perform the actual survey questioning. 
Unfortunately, human agents are expensive to hire, increasing survey costs, 
and humans often make mistakes, leading to survey inaccuracies. 
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[0005] One possible solution involves using computer-operated 
surveys where the participant uses the touch-tone feature of a telephone to 
enter replies to questions. However, such a system seems impersonal to the 
participant, often leads to mistakes if the participant forgets the key/answer 
mapping, and is limited to the use of touch-tone telephones. Such a solution 
also does not provide an adequate means to get actual participant verbal 
responses to questions. Actual recorded verbal responses have the 
advantage of capturing the participant's subjective tone and emotional state, 
as well as capturing the participant's objective opinion. 

[0006] It would be advantageous to automate the survey process to 
reduce the number of human beings utilized in the survey process, to 
increase the accuracy, reduce the costs, improve the efficiencies, and 
overcome the shortcomings of current techniques identified above. Modern 
computer and networking technology provides potential solutions to these 
problems. Advances in automated voice recognition, database design, 
computer processing, and computer networking all provide means to improve 
the process of performing a survey. 

[0007] In addition, because all survey participants tend to be asked 
the same p re-determined list of questions, little insight into the particular 
reasons behind the answers are typically available. Conventional means of 
solving this problem may involve having a participant state a reason for their 
answer. However, the consumer of a survey assessment may only be 
interested in detailed reasons behind an answer in particular situations, such 
as when a consumer is very dissatisfied with a service or product, while the 
same consumer may not care why a survey participant was satisfied with a 
service or product. Also, processing these stated "reasons" using standard 
techniques can be difficult, time consuming, and costly. Accordingly, an 
adaptable survey questioning procedure would be useful, one that determines 
the depth of questioning on certain topics depending on the answers given to 
questions on that topic, and that utilizes computer technology to process 
verbal replies. 
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[0008] Conventional written surveys attempt to solve this process by, 
for example, telling a participant to "skip section X if you answered 'no' to 
question Y" or to "complete section Q only if you answered 'poor' to question 
T". Telephone or personal surveys often require the survey agent to follow 
similar instructions. This can be confusing and frustrating to participants and 
agents alike, often leading to errors or incomplete surveys. More 
sophisticated, automated survey techniques that depend on neither the 
participant nor agent's understanding of the survey structure would be 
advantageous. 

[0009] In summary, better utilization of modern computers, software, 
and communication technologies while reducing reliance on human agents 
performing survey questioning would be beneficial to the consumers of survey 
information and the survey participants, as well as the agents performing the 
surveys. 

Summary of the Invention 

[0010] The invention is a system for collecting and presenting survey 
information made up of a connecting device connected to an external 
communication system for connecting the external communication system to 
a survey participant, a CATI unit connected to the connecting device, which 
transfers the communication connection of the participant to the CATI unit 
when the connection is successful, and further wherein an agent uses the 
CATI unit to ask the participant manual survey questions. 

[001 1] The invention also has an IVR unit connected to the CATI unit, 
wherein the CATI agent transfers the participant's communication connection 
to the IVR unit for conducting an automated survey, wherein the IVR unit 
accepts oral responses from the participant. As an alternative, the CATI 
agent may ask the participant for permission to transfer the participant's 
communication connection to the IVR unit for an automated survey. If the 
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participant does not give permission for an automated interview, the CATI 
agent conducts a manual interview. As a further alternative, the IVR unit can 
be set up to transfer the participant's communication connection back to the 
CATi unit on a voice command, wherein the CATI agent can continue with a 
manual survey. 

[0012] A database is used for storing the participant's responses to 
the manual survey and/or the automated survey. 

[0013] A CTI unit may also be a part of the system, wherein the CTI 
unit is connected to said Connecting device to monitor the status of the 
device, and further wherein the CTI unit is also connected to the CATI unit to 
monitor the status of the CATI unit and the agent using the CATI unit; and still 
further wherein the CTI unit is connected to the IVR unit to monitor the 
conducting of the automated survey. 

Brief Description of the Drawings 

[0014] FIG. 1 is a block diagram showing the ICS external interfaces. 

[0015] FIG. 2 is a block diagram showing the major ICS components 
connected to a LAN. 

[0016] FIG. 3 is a block diagram showing the major ICS components 
along with the primary data flow between them. 

[0017] FIG. 4 is a flow chart describing the high-level survey process 
with a survey participant. 

[0018] FIG. 5 is a flow chart providing an example of the drill-down 
questioning technique. 
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Detailed Description of the Invention 

[0019] FIG. 1 shows a block diagram of the Integrated 
Communication System (ICS), along with its major interfaces with external 
entities. The ICS is the system upon which the interactive survey and data 
management method is implemented. The ICS is a fully integrated data 
collection, data computation, and data presentation system representing an 
advanced call center technology infrastructure. 

[0020] As shown in the figure, the ICS connects to an external 
communication system, typically a telephone network, although the ICS can 
utilize other types of communication networks as well, such as the Internet 
and Internet telephony, private networks, cellular networks, and radio 
networks, among others. 

[0021] A survey participant is contacted via the external 
communication network, such as by calling the participant, and the participant 
is requested to participate in the survey. Alternatively, the participant might 
initiate the connection, such as by calling a special phone number. 

[0022] The ICS interacts with various personnel, such as CATI agents 
and monitoring agents, who may be considered a part of the system in some 
implementations. The CATI agents use a Computer-Assisted Telephone 
Interview (CATI) Unit to help communicate with the participant and perform 
manual surveys utilizing the ICS system and its methods to provide manual 
survey activities, when necessary. Monitoring agents can interact with the 
system in order to evaluate the system, and to evaluate the CATI agent 
performance. The ultimate user of the developed survey information is a 
survey consumer (i.e., a potential "customer" of the ICS). The consumer, 
when his or her identity is verified and validated, has access to survey data 
and processed survey information generated by the system for his or her use. 

[0023] FIG. 2 shows the major components of the ICS. The ICS 
contains a communication system connecting device, for example, a dialer 
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unit when a telephone system is used as the communication system, for 
initiating the communication connection with the participant. The ICS also 
contains the Computer-Assisted Telephone Interview (CATI) unit, which is 
used by a CATI agent to perform manual surveys; an Interactive Voice 
Recognition (IVR) unit that can perform automated surveys by interacting 
orally with the participant, and which utilizes a voice recognition module to 
interpret participants' responses; a Computer Telephony Interface (CTI) Unit 
for monitoring the progress of the surveys and the system; a Database for 
storing data generated by the surveys, the CTI unit, and the ICS system itself; 
a Voice On Demand (VOD) Unit which utilizes a Transcriber to transcribe and 
retrieve online stored interviews; an Intramed, which utilizes the Quality 
Desktop, which in turn utilizes the Clinical Value Compass, to provide remote 
data access to the consumer of the survey data; and a host Local Area 
Network (LAN) to connect all of the components together, as shown. 

[0024] The LAN provides automated database interchange between a 
consumer's computer and the ICS to collect demographic profiles of members 
of a survey sample, costs, or clinical and biological outcome data. The 
connection from the LAN to the consumer computer may be via a Wide Area 
Network, such as the ubiquitous Internet, to ensure widespread availability of 
access. The LAN also provides the communication platform for the various 
ICS components. 

[0025] FIG. 3 shows the primary data interchange between the 
major ICS components, and between the ICS and external entities. The LAN 
supports this data communication, but it is not shown in the diagram for the 
sake of simplicity. The Internet, or other external networks, may also support 
this communication structure, especially communication between the external 
entities and the ICS LAN, but these networks are also not shown for 
simplicity. 

[0026] The Dialer unit is an automated outgoing telephone call 
connection device that dials a programmed series of respondent telephone 
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numbers (which may be stored in the Database) at scheduled times. The 
Dialer unit transfers a successfully connected call to the CATI unit, and thus to 
a CATI agent, when a participant answers. The Dialer unit could be 
implemented by using a personal computer programmed to perform the 
dialing functions, or by using a dedicated device designed for this purpose. 

[0027] The CT1 unit monitors the activity of the Dialer unit, and 
creates a "call record" that follows the routing of each outgoing and incoming 
call; provides instantaneous "pop screens" to agents for fielding surveys; and 
provides extensive campaign statistics, such as the number of attempts per 
respondent, the call duration, and the mode of completion. The CTI unit can 
also monitor the status of surveys as they are being conducted by the CATI 
agent and the 1VR unit. The CTI unit might be implemented using a personal 
computer programmed for this purpose. Alternatively, this program could be 
run on a computer performing other functions as well to maximize the 
utilization of computing resources. 

[0028] The CATI agent is a trained call center agent who uses a CATI 
unit to start surveys by introducing the connected participant to a survey. The 
CATI unit would most likely be implemented by programming a computer 
terminal to perform the required functions. Alternatively, the CATI unit 
program(s) might be multitasked on a computer along with other computer 
programs, or multiple instances of CATI programs. However, it is likely that 
each CATI agent will operate his or her own CATI unit to avoid undesirable 
interactions between various agents and to allow an agent to have complete 
control of the corresponding CATI unit. The CATI unit can utilize "pop- 
screens" to provide information to the CATI agent, while the CATI agent can 
enter information into the CATI unit using a mouse and/or keyboard. The ICS 
allows for multiple CATI agents each operating their own CATI unit to perform 
a plurality of simultaneous (or staggered) survey interviews with many 
different participants. This capability increases the efficiencies of the system. 
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[0029] The flow chart of FIG. 4 shows the high-level sequence of 
events that occurs after a participant has been connected to the system. After 
the Dialer unit has successfully connected a selected participant, the CATI 
agent asks the participant for permission to conduct a survey. If the 
participant agrees, the CATI agent then requests permission to allow the IVR 
unit to conduct an automated survey. If the participant again agrees, the 
participant is connected to an IVR unit, which performs an automated survey. 

[0030] If the participant agrees to participate in the survey but refuses 
to be transferred to the IVR unit, the CATI agent will manually conduct the 
survey using the CATI unit. Although it is preferable to conduct as many 
surveys as possible using the IVR unit from a cost and efficiency perspective, 
CATI agents conducting manual interviews are useful to increase the total 
number of participants involved in a survey, since not all participants are 
willing to participate using an automated system, and thus the use of CATI 
agents tends to increase the total sample size of the resulting survey 
collection. 

[0031] The CATI agent may be responsible for recording or 
transcribing the participant's responses to the survey questions using the 
CATI unit keyboard, or, preferably, the CATI agent may select a response 
from a p re-determined list, such as through the use of a mouse and/or 
keyboard. Alternatively, the CATI unit might utilize voice recognition 
technology to automatically transcribe and record the participants' responses, 
perhaps allowing the CATI agent to monitor the result and make corrections 
when necessary. The CATI agent can also transfer the participant back to an 
agent during an IVR interview if necessary. 

[0032] The CATI unit of the invention differs from other types of 
"CATI" programming in that it is network-scheduled and controlled, and it is 
fully integrated with IVR interviews so that interviews can be handed 
transparently from one environment to the other. This feature is made 
possible by using an integrated script programming language, for example. 
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[0033] The IVR unit is a computer device on which survey scripts can 
be deployed. The IVR unit asks questions of the participant using 
synthesized or recorded speech, and it receives answers orally from the 
participant. The unit breaks down incoming speech into phrases and 
responses and hands them off to the voice recognition module, to interpret 
oral responses by the participant. Since speech recognition is used by the 
IVR unit, touch-tone functions are typically not necessary. To increase the 
accuracy of the voice recognition function, the suggested responses to survey 
questions are carefully chosen in order to improve the ability of the voice 
recognition module to interpret the responses. The IVR unit collects the 
participant responses, consults with a script to decide what to say in 
response, and then causes that response to be spoken to the other party or 
parties on the phone. In addition, it manages a telephone trunk line, including 
dialing outbound calls and answering inbound calls. It conferences and un- 
conferences human agents. It can record pieces of incoming speech or whole 
conversations. 

[0034] The IVR unit may be able to handle multiple instances of 
automated interviews with a number of different participants, thus increasing 
the efficiencies of the IVR function. Multiple IVR units could thus handle large 
numbers of participants simultaneously. 

[0035] At any time, the participant participating in an IVR automated 
survey may transfer the survey back to a CATI agent by voice command, 
such as by asking for "Help" or some similar trigger word(s) or phrase(s). The 
CATI agent can then answer any questions the participant might have, and 
the agent can continue the same survey interview at the point where the IVR 
unit left off. In this way, participants are not left "stranded" with the automated 
unit, making it less likely that the participant will terminate the survey 
prematurely and thus making completion of surveys more likely. 

[0036] A manual CATI agent survey follows the same question 
pattern as one that is performed by the IVR unit. Both follow survey scripts 
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with a pre-determined question format that utilize drill-down questioning 
(described hereinbelow) and the surveys also utilize verbatims (audio 
recordings of actual answers— also described hereinbelow). The survey 
responses provided by the participant to either the IVR unit or the CATI agent 
are stored in the Database for later analysis and retrieval. 

[0037] A Scheduler program (not shown) could be used for allocating 
resources in the networked environment. This program helps organize 
resources, deciding how to match needs for human agents against a pool of 
available agents, and causing the IVR unit program to undertake this. It also 
includes synchronizing agent terminals and the IVR unit when transferring 
between automated telephonic, internet-based, and agent communication, so 
that the participants in the survey are transferred seamlessly in each direction. 
This program also makes short-term decisions about whom to dial, and 
maintains records of the results of conversations for other programs in the 
system. 

[0038] The survey responses from various participants stored in the 
database contain raw survey data, which must be processed in order to be 
converted into survey information useful to survey consumers. The 
Processing Unit represents this processing of raw survey data into useful 
survey information. This unit could be implemented using a computer with off- 
the-shelf statistical processing software, or by running a customized program 
on a personal computer. Some processing may need to be done manually, 
such as the transcription of verbatims into text. However, as voice recognition 
technology improves, automated transcription may also be utilized. 

[0039] The actual processing required may depend on the needs of 
the ultimate consumer of the survey information. Normalized summaries and 
comparisons between various units and departments, product or service 
quality measurements, normalized response times, and information about 
specific products, services, employees, or departments, can all be obtained 
as desired. 
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[0040] For example, in the medical field, where the invention is 
expected to provide immediate utility, useful information that can be obtained 
from processing raw survey data includes: 

(A) generating consumer satisfaction measures such as: 

(i) consumer loyalty measures; 

(ii) medical care satisfaction measures; 

(iii) medical facility satisfaction measures; 

(iv) medical staff satisfaction measures; 

(v) positive comments with reasons; and 

(vi) negative comments with reasons; 

(B) generating staff rating measures such as: 

(i) staff loyalty measures; 

(ii) staff performance measures; 

(iii) staff satisfaction measures; and 

(iv) staff continuing education measures; 

(C) generating doctor rating measures comprising: 

(i) quality of medical care measures; 

(ii) doctor performance measures; 

(ii) doctor satisfaction measures; 

(iii) doctor loyalty measures; and 

(iv) doctor continuing education measures; 

(D) generating care delivery measures such as: 

(i) cost measures including: 

(a) cost of medical care paid by consumer measures; 

(b) cost of medical care paid by non-consumer 
measures; 

(c) cost of providing medical care measures; and 

(d) overhead costs measures; 

and 

(ii) profit measures; 

(E) generating medical care quality assessment measures such as: 

(i) mortality measures 

(ii) morbidity measures; 

(iii) complications measures; 

(iv) medical procedure results measures; 
(iv) medical procedure follow-up measures; 

(vi) patient mental health measures; 

(vii) social impact measures; 

(viii) hospital stay length measures; 

(ix) HEDIS® technical quality measures; and 

(x) PM PM cost measures; 

(F) analyzing the generated measures and survey data, such as: 
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(i) aggregating survey data to form assessments; 

(ii) normalizing comparisons between specific named units 
including: 

(a) doctors or specialists; 

(b) medical care organizations or divisions; 

(c) staff persons; 

(d) managers; 

(e) specific medical treatments; and 

(f) patient group status; 

(iii) determining changes over time; 

(iv) determining differences geographically; and 

(v) generating summaries. 

[0041] The resulting survey information can then be formatted for 
display in graphical, textual, or even full-motion video, as appropriate for the 
type of information being examined and displayed. Charts and graphs of 
various types and textual reports can all be generated from this information, 
when desirable. The ICS may include interactive features to allow the 
consumer to manipulate the data source, display format, or survey being 
shown. In addition, the system could provide information in audio format, 
such as by playing the actual participant verbatims as originally recorded. 

[0042] A VOD unit could contain millions of surveys interviewed by 
CATI agents or IVR units that are stored in a database for easy retrieval and 
transcription of participant free-text comments (i.e., verbatims) and ratings. 
VOD is also used to evaluate agent performance in fielding interviews and 
performing CATI surveys, and for ongoing evaluation of speech recognition 
patterns. 

[0043] An Intramed unit provides the consumer with remote access to 
data, often within 24 hours of its collection across a Virtual Private Network 
(VPN), which can be used to keep ail data off the public Internet (unless 
encrypted) and ensure privacy and security. This unit authenticates the 
consumer end user, encrypts and de-encrypts data transferred to the desktop 
workstation on which the outcome measurements presentation operates and 
where all archival and dynamic data is stored. The VPN keeps all data off the 
public internet and ensures privacy and security. Alternatively, system access 
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can be provided to the consumer by using standard Internet security 
programs and tools, such as by using web browsers with ID and password 
verification, or by using encryption and/or security certificates to verify users 
and ensure that data integrity and privacy is preserved. 

[0044] The consumer computer could have the Quality Desktop 
installed to connect to Intramed. The Quality Desktop uses the Clinical Value 
Compass to provide survey information in a useful and properly formatted 
display. Alternatively, the Quality Desktop could be run remotely on a server, 
with the user computer displaying the information using a client program such 
as a web browser or similar display tool. In that case, no specialized software 
need be installed on the consumer computer. 

[0045] FIG. 5 is a flow chart showing a simple example of the 
interactive survey script approach, wherein focus or drill down surveys 
containing "drill-down" questions, and open-ended questions called 
"verbatims", are deployed by the survey. The questions are pre-determined, 
but this survey format allows the questioning to "drill-down" into greater 
detailed questions when certain specific responses are given. As shown in 
FIG. 5, it may be that answers A and B of question N are of sufficient detail for 
survey analysis, such that no additional questioning on that specific topic is 
necessary, while answer "C" requires specific follow-up questioning (i.e., NT) 
to get greater detail on the reasons for the answer "C", for example. Thus, 
only if the participant answers "C" to question N is question N' asked next. If 
the participant answers C to question N\ then the participant could be asked 
to leave a detailed "verbatim" response to explain his or her answer, while 
answers A' and B' to question N' might require no verbatim. The survey can 
then go on to the next normal question, N+1. 

[0046] Using these "drill-down" question techniques, the survey can 
be "customized" according to the actual responses of the participant. Multiple 
variations and levels of drill-down questioning are possible, depending on the 
purpose of the survey. This capability allows a survey to gather greater detail 
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in those subject areas where a survey consumer might want greater detail, 
while conserving resources by only asking for that detail when appropriate. 
The drill-down format could go quite deep into a subject area before requiring 
a verbatim, or it may only go down a layer or two as shown in FIG. 5. Drill- 
down questioning is discussed in co-pending application INTERACTIVE 
SURVEY AND DATA MANAGEMENT METHOD AND APPARATUS, Nelson 
et a/., incorporated herein by reference. This application is also related to 
provisional applications serial numbers 60/245,753 and 60/245,769, 
incorporated herein by reference. 

[0047] As an example in how to utilize the system in a quality 
improvement program, survey information consumers might want to review 
their organization's data in an area where a standard survey, implemented by 
the ICS or some traditional alternative, had identified some performance 
deficiencies. Focus surveys can be designed and implemented to collect the 
necessary raw data from the organization's customers and/or staff. The raw 
survey data is processed, formatted, and made available to the appropriate 
persons via the ICS, providing useful information and conclusions so that the 
management of the organization is in a position to better understand the 
cause of the deficiency and make the proper corrections, thereby improving 
the quality of goods and/or services and the performance of the organization. 

[0048] After making changes (to correct the deficiency), focus surveys 
can be designed and/or performed again to measure the impact of the 
changes and perhaps fine-tune the results. 

[0049] Finally, the ratings obtained in an ongoing standard survey 
should reflect the performance and quality improvement resulting from the 
changes. The focus surveys are then suspended, and the quality 
improvement program has successfully implemented the ICS, leading to 
marked improvements in quality. 
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[0050] The invention has been described hereinabove using specific 
examples; however, it will be understood by those skilled in the art that 
various alternatives may be used and equivalents may be substituted for 
elements or steps described herein, without deviating from the scope of the 
invention. Modifications may be necessary to adapt the invention to a 
particular situation or to particular needs without departing from the scope of 
the invention. It is intended that the invention not be limited to the particular 
implementation described herein, but that the claims be given their broadest 
interpretation to cover ali embodiments, literal or equivalent, covered thereby. 
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